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ABSTRACT 



This report gives a general outline of the 
postdoctoral fellowship program offered by the Educational Testing 
Service (ETS) and describes the specific program designed for Dr. 
William Wiersraa, director of the Center for Educational Research and 
Services at the University of Toledo, who was the only fellow during 
1969-70. In addition to attendance at the Distinguished Visiting 
Scholars Lecture Series and the Research Seminar Series, Dr. Viersma 
worked closely with Dr. Charles E- Hall of the ETS in developing a 
multivariate analysis of variance computer program. (Appendixes 
contained a paper: "The Geometric Construct of Multivariate Analysis 
of Variance" by Wiersma and Hall and lists of speakers for the 
Distinguished Visiting Scholars Lecture Series and the Research 
Seminar Series.) (RT) 
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Introduction 



This report covers the activities in the Postdoctoral Fellowship 
Program at Educational Testing Service from July 1, 1969 through 
June 30, 1970# The Program is designed to provide for a limited 
number of outstanding individuals who hold the Ri.D. or Ed.D. degree 
a year of experience at Educational Testing Service designed to 
irprove their capabilities to conduct sound educational research and 
to train others in research methods and procedures# During the year 
beginning July 1, 1969 one fellow participated in the program. 



Description of the Program 



The primary orientation of the Postdoctoral Program in Educa- 
tional Research at ETS is toward providing each participant with a 
flexible program of experiences to inorease his competence as a 
practitioner in the field of educational researoh or as a teacher 
of potential researchers. A major assumption of the Program is that 
the best training for educational research is aotual participation in 
the planning and conducting of important and well-oonceived research 
projects. It is further assumed that the broad program of research 
under way at ETS, together with the variety of opportunities for 
interaction among staff and between staff and visitors at ETS, provides 
an effective setting within which the participants may broaden and 
deepen their insights. 

The Postdoctoral Program in Educational Research is the re- 
sponsibility of the four Research Divisions at ETS — The Develop- 
mental Research Division, the Division of Educational Studies, the 
Division of Psychological Studies and the Office of Confutation 
Sciences -- which conduct research related to specific problems in 
schools and colleges. Projects within these Divisions cover the full 
range of the educational system from preschool through graduate school 
to continuing education in the professions, and involve a wide variety 
of research methods. Many of the projects are carried on in close co- 
operation with schools and colleges, offering research workers an op- 
portunity to practice skills in diplomacy and communication as well as 
those in statistical analysis, experimental design, and theory con- 
struction. 

It is planned that each of the participants will mend ap- 
proximately two-thirds of his time working direotly with one or more 
research teams on specific projects under way. The other third of 
his time is to be spent on a program of supplementary activities which s 
draw on the over-all resources of ETS to round out his training ex- 
perience. Eaoh scholar is to plan the details of his particular program 
in consultation with the Director of the Program, a senior member of the 
Developmental Research Division. 
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Qne fellow participated in the Postdoctoral Fellowship Program at 
Educational Testing Service during the 1969-70 year. He was 
Dr, William Wiersma, Director of the Center for Educational Research 
and Services at the University of Toledo. Dr. Wiersma was at ETS 
during the nine month period beginning September 1, 1969. During his 
stay, the majority of Dr, Wiersma’ 8 efforts were directed toward the 
development of a good understanding of all phases of the use of multi- 
variate analysis of variance, including the preparation of data for 
analysis, the conputer runs and the interpretation of the computer 
output. In this endeavor, Dr, Wiersma worked quite extensively with 
Dr. Charles E. Hall who is a member of the ETS Office of Conputational 
Sciences and who has had primary responsibility for the development of 
a versatile multivariate analysis of variance computer program. The 
depth of understanding of multivariate analysis of variance that 
Dr. Wiersma gained while at ETS is indicated by the manuscript included 
in Appendix A which he wrote in collaboration with Dr. Hall. 

Among the special programs open to Dr, Wiersma were the Distinguished 
Visiting Scholars lectures and seminars and the Research Seminars. 
Announcements of these programs (Appendix B) were distributed to Dr, Wiersma 
and he was encouraged to participate to the extent that his schedule and 
interests permitted. Dr. Wiersma also attended the meeting of the American 
Psychological Association, the Invitational Conference on Testing Problems, 
and the American Educational Research Association. 

There were no changes of staff involved with the program between 
the time of the preparation of the original proposal and the initiation 
of the Program. Thus, the staff available to work with Dr. Wiersma 
remained as outlined in the application for participation in the Program. 

The vast majoiity of Dr. Wiersma's time, however, was spent working with 
Dr, Charles E, Hall. 



Evaluation of the Program 



The original intent of the Program was to increase the supply of 
individuals capable of designing and conducting educational research 
and of training other researchers. Originally, three types of indi- 
viduals were thought to be appropriate as candidates \ (l) erployces 

of school systems engaged in educational research who might profit 
from a refresher experience, (2) staff members in colleges and univer- 
sities engaged in training educational specialists, and (3) specialists 
in subject areas other than education who wished to apply their methods 
to educational problems. Dr. Wiersma clearly qualified for the program 
in categories (2), 

The Program at ETS was designed on the assumption that the best post- 
doctoral experience would be one involving active participation in ongoing 
research projects already under way at ETS, supplemented by individualised 
programs of study drawing on ETS resources such as the library, fomal 
classes, scheduled lectures by visiting scholars, and the like. In 
general, the assumption seems to have been sound. 
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One limitation on flexibility was the necessity for a project to be 
funded In order that costs of data collection and processing might be 
met. Since Dr. Wiersma 's interests were primarily in the application 
of multivariate statistical techniques some difficulty was encountered 
in finding on-going projeots with appropriate needs at appropriate times. 
Two steps were taken to meet this problem. First Dr, Wiersma was able 
to obtain data that he had worked with at the University of Toledo that 
were appropriate for the application of multivariate analysis of variance. 
This solution had the added advantage of providing data with which 
Dr, Wiersma was already familiar and in which he already had an interest. 
Ihe recond step was the allocation of money from ETS research funds for 
his personal research. As of April 1, 1970, $11*53 of this fund provided 
by ETS had been expended for computer and secretarial expenses. 

Dr. Wiersma conducted at least ]£ multivariate analyses of variance with 
his own data. Some of these analyses will be included as examples in 
two chapters of a book Dr. Wiersma is preparing. 

It is our Judgment that Dr. Wiersma was equipped to profit from 
the type of program offered at ETS. As mentioned earlier the report 
presented in Appendix A provides partial support for this Judgment. 



Program Reports 



1* Publicity 

The Program Brochure, which is included in Appendix C, was distributed 
to ETS staff members with the suggestion that they tell their friends and 
acquaintances in colleges and school systems about the program and ask 
them to inform likely candidates. 

2 • Appl ic ation Summary 

a. Approximate number of inquiries from prospective 



trainees 8 

b. Number of corpleted applications 3 

c. Number of first rank applications 3 

d. How many applicants were offered aebnission 3 



V 

* 
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3. Trainee Summary 

a. Number of trainees initially accepted in program 1 

Number of trainees enrolled at the beginning 

of program 1 

Number of trainees who completed program 1 

b. Categorization of trainees 

(1) Number of trainees who principally 
are elementary or secondary public 

school teachers 0 

(2) Number of trainees who are principally 
local public school administrators or 

supervisors 0 

(3) Number of trainees from colleges or 

universities _ 1 

h. Program Director^ Attendance 

a. What was the number of instructional days for 

the program? 195 

b, What was the percent of days the director was 



present? 




90* 


Financial Surroary 


Budget as Reviotu 


Expended or 






Cormitted 


a. Stipends 


$18,000 


$18,000 


b. Trainee Travel 


2,000 


2,035 


c, Institutional 
Allowance 


1,000 


1,000 


TOTAL 


$21,000 


$21,035 
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The Geometric Construct of Multivariate Analysis of Variance 

Williwn Wiersma Charles Hall 

and 

Educational Tenting Service Educational Tenting Service 




ABSTRACT 



The Geometrical Construct of Multivariate 
Analysis of Variance 

Multivariate analysis of variance (KAMOVA) has been frequently used 
in the analysis of multi-response data. However, rarely is the underlying 
geometry of MANOVA discussed. In the present paper *vo cases for the 
one-way MANOVA are considered: (l) the case in which the number of signifi- 

cant canonical variates is less than the number of possible canonical 
variates, and (2) the case in which the number of significant canonical 
variates equals the number of possible canonical variates. The geometry 
Of MAMOVA's involving tvo or more factors is also discussed. 
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The Geometrical Construct of Multivariate 
Analysis of Variance 



Many educational research problems involve more than one response 

secured from the subjects under study. One approach to the analysis of 

( ‘ 

multi-response data is through a multivariate analysis of variance (MAHOVA) . 
The theoretical framework for this procedure has been in development for 
over ^0 years (see, for example, Roy & Gnanadesikan, 1959). However, 

MANOVA has not been extensively utilized by educational researchers. There 
are probably several reasons for this lack of use, among them a lack of 
familiarity with the procedure, and the limited availability of computer 

r * ^ 

programs . ’■ • 

Several authors have, alluded to the apparent, if not obvious, appli- 
cability of MAH OVA in educational research (e.g., Pruzek, 1969) . It is a 

•v ■ . ; • 

technique by vhich the responses to two or more dependent variables can 
be analyzed simultaneously and thus it includes the correlations that may 
exist between the dependent variables. In a MAHOVA, the dependent variables 
are combined linearly to produce canonical variates. (Canonical variates 
are hypothetical variables made up of seme linear combination of the real 
variables being analyzed. In essence, they correspond to factors of fac- 
tor analysis.) The various groups or levels of the design are then dif- '' 
ferentiated in terms of their mean scores on the canonical variates. The 
significance of the mean canonical variate scores is then tested by Wilk's 
lambda i criterion (or its F distribution approximations (Rao, 1965)) » Roy’s 
largest root criterion (Heck, i 960 ) or Hotelling’s trace criterion (Pillai 
& Samson, 1959). The crux of the analysis is in the interpretation of 
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the canonical variates and how the groups differ on them. Underlying this 
interpretation is a geometrical construct and that construct is the prime 
consideration of this discussion. 

• The MANOVA analysis provides for us, among other things, the number 
of canonical variates and a statistical estimate of how many are signifi- 
cant. Most computer programs designed to calculate MANOVA analyses, also 
provide adjuncts such as the attendant discriminant functions. Suppose we 
have a one-way MANOVA design, m levels and n dependent or criterion 
variables. Let NCVAR be the total number of canonical variates and SIGCV 
the number of significant canonical variates in the data. 

In a MANOVA analysis the number of possible canonical variates is 
limited to the smaller of n , the number of dependent variables, or 
m - 1 , the degrees of freedom associated with groups or levels. Therefore, 
• in our notation NCVAR = min (m-l,n) . 

There are two possible situations that can arise and we will refer to 
them arbitrarily as Case I and Case II. Case I is the situation in which 
SIGCV < NCVAR n . We know that we have SIGCV canonical variates among 
the n real variables. Thus the differences between the m levels of 
the independent variable can be explained in terms of SIGCV < m-l,n 
canonical variates. 

Geometrically we can claim that the n dependent variables consti- 
tute an n -dimensional space. The m groups or levels are an m - 1 
dimensional space (because there are only m - 1 ways in which the levels 
can be different, i.e., degrees of freedom). The n -dimensional depend- 
ent variable space and the m - 1 levels space overlap. In fact, if 

POOR ORIGINAL COPY- Bf-Sf 
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n < in - 1 the dependent variable space lies completely within the levels 
space as an embedded subspace; conversely if m - 1 < n the levels space 
lies completely within the dependent variables space. Regardless of 
whether m - 1 < n or n •< m - 1 , the total number of canonical variates 

is NCVAR *» min (n,m-l) and all the canonical variates lie inside the 

•smaller dimensional space and is exactly that space. Geometrically we have 

a large dimensional space of n (or m - 1 ) dimensions in which there 

lies a smaller space of m - 1 (or n ) dimensions which is also the 
space of the NCVAR canonical variates. 

For Case I we have chosen SIGCV < NCVAR which says that the space 

of the significant canonical variates is smaller than the space of all the 

canonical variates. For Case I we have three vector spaces each embedded 
completely in the next larger. The significant canonical variates space 
(dimension SIGCV) is embedded in the total canonical variates subspace 
(dimension NCVAR *= min (n,m-l) ) which is in turn embedded in the larger 
space of dependent variables (dimension n ) or, if m - 1 > n , the larger 
space of the levels (dimension m - 1 ). , 

• Next we consider the relative orientation of these subspaces in the 
larger space. Suppose n > m - 1 . Thus the largest space we have in 
our geometrical construct has n dimensions. The original dependent 
variables, however, are likely not to be orthogonal. They fall on dimen- 
sions in this space that are oblique. The NCVAR lie in an m - 1 dimen- 

sional space which does have all dimensions orthogonal. The original 

' 0 

dependent variable scores are projected onto the m - 1 axis of the NCVAR 
space. (These projections are accomplished by the discriminant functions.) 
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The space of SIGCV is of fever dimensions, say k , than m - 1 . K of 
its axes correspond exactly with k axes of the NCVAR space (e.g., coin- 
ciding a plane exactly within two of the dimensions of a cube). The pro- 
Jections of the discriminant scores of the ra - 1 groups onto the k 
axes are far enough apart so that their differences are statistically sig- 
nificant. The (m - l) - k dimensions of the NCVAR space that do not 
represent significant canonical variates are such that the corresponding 
projections onto them are not different enough to attain statistical sig- 

i 

nificance. In essence, the information of group differences on the n 
dependent variables is successively transformed through projections until 
it is contained in the k -dimensional space. Thus the difference be- 
tween the m levels of the design relative to the n original variables 

can now be explained in terras of the dimensions represented by the canoni- 

« * 
cal variates. Obviously this is a desirable situation since we have 

accounted for all possible canonical variates in the real data. If k 

is much less than NCVAR we have considerable redundancy among the means 

of the groups . 

Case II is the situation in which SIGCV *= NCVAR.; that is, all possible 
canonical variates are significant. Now SIGCV = min (m-l,n) , say m - 1 . 
This is an m - 1 dimensional subspace of n . The space of the SIGCV 
coincides exactly with the m - 1 dimensional space of NCVAR. We know 
that in the real data of the n dependent variables there exist at least 
k significant canonical variates. The information of the dependent 
variables is projected into these m - 1 dimensions. The limitations of 
the (sampling) design preclude the existence of additional canonical 
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variates. The data of the n dependent variables are now collapsed via 
the discriminant function, a transformation, into the k dimensional sub- 
space that provides the "best fit" within the limitations of the design. 
However, some of the information of the data may lie outside the dimensions 
of the SIGCV space. An obvious disadvantage of this case is that although 
we have the "best" set of canonical variates for the design, we may not 
have identified all the significant means variation that may exist in the 
original n variables'. The relative orientation of the subspaces for 
Case II is like that of Case I, except that there is one less subspace in 
that the NCVAR and SIGCV spaces are in fact the same. 

In summary, the difference between Cases I and II, as discussed above, 

is that in Case II the NCVAR ** SIGCV space may contain only part (the 

major part) of the separation of group means. There may be extra dimen- 
* 

sions outside the NCVAR = SIGCV space that have significant variance in 
group means but the NCVAR dimensions are too small in number to be able to 
encompass these, whereas in Case I - 1 1 the significant means variance is 
in the SIGCV dimensions. 

In many educational research situations we include more than one de- 
sign factor in a single analysis. Indeed, one of the desirable character- 
istics of analysis of variance is its capacity to accommodate more than 
one design factor. This also provides the opportunity of investigating 
possible interactions among the factors. Correspondingly it is often de- 
sirable to include more than one factor in a MANOVA. What does this do 
to the geometry of the situation? 

. Suppose we have an analysis involving J design factors, * ’ ’ **J 

levels respectively. The total number of degrees of freedom associated 
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vith these variables is IU^ - 1 . Thus, in a MANOVA the maximum number 
of significant canonical variates that can appear among all the main 
effects and interactions is the minimum of IUj - 1 or n . Assume 
- 1 < n . For the analysis of any main or interaction effect the 
.maximum number of significant canonical variates possible is the df asso- 
ciated vith that effect, say df^ . Within any one effect, i , the canoni- 
cal variates are orthogonal and are at most dfj in number. However, 
across effects orthogonality of canonical variates is not insured, in 
fact orthogonality is extremely unlikely in most situations dealing vith 
educational or psychological variables. 

Suppose a total of k' significant canonical variates appear in a 
MANOVA involving J > 1 factors. This is- the total number of signifi- 
cant canonical variates from all main and interaction effects. Let 
k 1 < II£^ - 1 < n . Thus ve know that the canonical variates are contained 
in a space of no more than k' dimensions; however, i t could be less than 
k* -dimensional. If n > IULj - 1 the MANOVA provides the possibility 
of a Ilt^ - 1 dimensional space for containing the n original dependent 
variables. From this it reduces the maximum dimension of the space con- 
taining the canonical variates to k' . As each main or interaction 
effect is being computed the significant canonical variates for that effect 
are orthogonal constructs in the k* -space. Each is actually a coordi- 
nate system of maximum dimension, the degrees of freedom of the effect, 
and actual dimension, the number of significant canonical variates asso- 
ciated with the effect. As ve proceed through the various effects ve are 
geometrically placing these coordinate systems in the k' -space. 
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The question now arises, "How many dimensions does this assortment 
of coordinate systems occupy?" The corresponding construct question of 
the MANOVA is "How many orthogonal canonical variates are needed to account 
for the differences among the levels of the factors?" One way to attain 
a measure of this is to reduce the analysis to a one-way MANOVA. In this 
case all cells indicated by the most detailed breakdown of the levels of 
the original J factors would come in as levels of the one factor.. The 
number of levels would be - 1 which is also the NCVAR. Suppose 

that this one-way MANOVA provides k significant (now orthogonal) canoni- 
cal variates. If k < k* <_ min (ntj-l,n) we know that the k 1 signifi- 
cant canonical variates from the original analysis can be contained in 
k dimensions.* • 

Consider the situation in which n < - 1 and n <_ k* . This is 

•the situation in which the number of significant canonical variates, 
totaled across all effects, is greater than the number of dependent vari- 
ables, a seemingly impossible situation. Empirically such results can 
appear. What has happened to the geometrical construct? 

Within any single effect, either main or interaction, the largest pos- 
sible SIGCV = min (df^,n) . As was discussed earlier the SIGCVs of a 
single effect are orthogonal and hence occupy as many orthogonal dimen- 
sions. If k* > n the basic space is still at. most n -dimensional and 
therefore there is at least some redundancy among the k' significant 



This conclusion is within the limits of statistical determination. 1 
Since the underlying distributions are approximated the statistical tests 
of significance, though considered adequate, are approximations. 
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canonical variates. Redundancy in terms of the analysis would mean that 
two or more canonical variates from different effects would tend to load 
heavily on the some dependent variables and are correlated. Geometrically, 
redundancy means that the dimensions representing two or more canonical 
variates are oblique. If we decide to reduce the factorial to a one-way 
analysis to obtain a measure of the number of dimensions, NCVAR = n . 

If k = SIGCV emerge and k < n , we then conclude that our SIGCV space 
can be contained in k -dimensions. If k = n , we have a Case II sitra- 
tion discussed earlier, and are subject to the limitations of that case. 

In the geometrical .x j struct of the MANOVA, the dimensions of interest 
are primarily those of the significant canonical variates, rather than 
either those of the original' n variables or even the total possible 
canonical variates. In a one-way MAHOVA all significant canonical vari- 
*ates are orthogonal. With two or more factors the significant canonical 
variates are orthogonal only within an effect, and the canonical variates 
of . one effect may be oblique to those of another effect. Generally canoni- 
cal variates are interpreted in terms of their correlations with the 
original dependent variables. The geometric construct does little for 
interpreting directly a specific canonical variate. Until MAHOVA programs 
include the actual computation of canonical variate scores and the corre- 
lations between nonorthogonal canonical variates, this part of the inter- 
pretation is strictly ad hoc . Such scores are possible, although the 
algorithm for generating them is undoubtedly tedious to program. However, 
the geometrical construct does provide a general model for initiating 
the interpretation of a MANOVA. 
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APPENDIX B 



Distinguished Visiting Scholars 
List of Research Seminar Speakers 
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EDUCATIONAL TESTING SERVICE 
announces the seventh annual senes of 
public lectures by 

DISTINGUISHED VISITING SCHOLARS 
during the academic year 

1969-70 

You are cordially invited to attend these six lectures, 
which will be given in the 
ETS Conference Center 
Rosedale Road 
Princeton, New Jersey 
8:15 P.M. 



October 13, 1969 

Dr. Kenneth E. Boulding 
Institute of Behavioral Science 
University of Colorado 
Boulder, Colorado 

November 3, 1969 

Dr. Nevitt Sanford 
The Wright Institute 
Berkeley, California 

December 1, 1969 

Dr. Raymond B. Catlett 
Laboratory of Personality 
and Group Analysis 
Department of Psychology 
University of Illinois 
Champaign, Illinois 



January 19, 1970 

Professor Howard S. Becker 
Department of Sociology 
Northwestern University 
Evanston, Illinois 

March 23, 1970 

Dr. Urie Bronfenbrenner 
Department of Child Development 
and Family Relationships 
College of Home Economics 
Cornell University 
Ithaca, New York 

May 18, 1970 

Dr. James S. Coleman 
Department of Social Relations 
The Johns Hopkins University 
Baltimore, Maryland 




1969-1970 

ETS RESEARCH SKMltlAltS 



Profcscor R. C, Oldfield 
Edinburgh, Scotland 



ProfesGor Alick Ell thorn 
London, England 



Dr. Peter Bentler 
University of California 
Los Angeles, California 

Dr. Hubert M. Blalock, Jr. 
University of North Carolina 
Chapel Hill , N.C. 

Dr. Florence L. Geis 
University of Delaware 
Newark, Delaware 

Dr. Paul L. Wachtel 
Hew Ycrk University 
Hew York, N. Y. 

Rosemary Williams 
Educational Development Center 
Newton, Massachusetts 

Dr. David S. Holmes 
University of Texas 
Austin, Texas 

Dr. Courtney B. Cazden 
Harvard University 
Cambridge, Massachusetts 

Dr. Edward E. Sampson 
University of California 
Berkeley, California 

Dr. David Hawkins 
Institute for Advanced Study 
Princeton, H.J. 

Dr. Salvatore Maddi 
University of Chicago 
Chicago, Illinois 



Dr. Melvin Tuiriin ' 

Princeton University 
Princeton, H.J. 

James Jenkins 
University of Minnesota 
Minneapolis, Minnesota 

Dr. Gene M. Smith 
Massachusetts General Hospital 
Boston, Massachusetts 

C. Victor Bunderson 
University of Texas 
Austin, Texas 

Warwick Elley 

Hew Zealand Council for Educational Research 
Wellington , New Zealand 

Daniel Solomon 

Institute for Juvenile Research 
Chicago, Illinois 
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APPENDIX C 



Program Brochure 
Application Form 
Certification Form 




POSTDOCTORAL PROGRAM 



IN 

EDUCATIONAL RESEARCH 




EDUCATIONAL TESTING SERVICE 
Princeton, New Jersey 08540 



POSTDOCTORAL PROGRAM IN EDUCATIONAL 



Educational Testing Service offera 
a Poatdoctoral Program in Educational 
Research , and may be named on applica- 
tions for one of the National Postdoc- 
toral Fellovahipa which will be award- 
ed each fiscal year through the Educa- 
tional Research Training Program of 
the United Statea Office of Education, 



Description of the Program 

The primary orientation of the Post- 
doctoral Program in Educational Re- 
search at ETS is toward providing each 
participant with a flexible program of 
experiences to increase his competence 
as a practitioner in the field of edu- 
cational research or as a teacher of 
potential reaearchera. A major asauop- 
tion of the Program la that the best 
training for educational research is 
actual participation in the planning 
and conducting of Important and well- 
conceived research projects. It is 
further assumed that the broad program 
of research under way at ETS 9 together 
with the variety of opportunities for 
interaction among ataft and between 
staff and visitors at ETS, provides an 
effective setting within which the 
participants may broaden and deepen 
their insights. 

The Postdoctoral Program In Educa- 
tional Research la the responsibility 
of the Developmental Research Division 
at ETS | which conducts research relat- 
ed to specific problems In schools and 
colleges. Opportunity is also provided 
to utilise the resources of the other 
three Research Divisions at ETS — the 
Division of Educational Studies , the 
Division of Psychological Studies, and 
the Division of Computation Sciences. 
Projects within these Divisions cover 
the full range of the educational sys- 
tem from preschool through graduate 
school to continuing education In the 



professions, and Involve a wide vari- 
ety of research methods. Many of the 
projects sre carried on in close coop- 
eration with achoola and colleges , of- 
fering research workers an opportunity 
to practice akills in diplomacy and 
communication as veil as those in 
statistical analysis, experimental de- 
sign, and theory construction. 

It is planned that each of the par- 
ticipants will apend approximately two- 
thirda of his time working directly with 
one or more research teams on specific 
projects under way. The other third of 
hia time la to be spent on a program of 
supplementary activities which draw on 
the over-all resources of ETS to round 
out his training experience. Each 
scholar is to plan the details of his 
particular program in consultation with 
the Director of the Program, a aenior 
member of the Developmental Reaearch 
Division. 

The selection of project assignments 
will be made in relation to the partic- 
ular needs of the Individual scholar 
and to the deairability of providing 
him with experiences in all phases of 
the research sequence— defining the 
problem, designing the study, collect- 
ing the data, analysing the data, and 
preparing the report. 



Supplementary Progrcn 

The supplementary program may include 
a variety of activities. Partlcipanta 
may have lull use of the Carl Campbell 
Brighan Library at ETS, to review re- 
search literature and to use the Library's 
extensive collection in psychology, edu- 
cation, and related fields, and its 
comprehensive Test Collection. During 
the academic year there ate eeminara at 
which Distinguished Visiting Scholars or 
members cf the ETS Staff present research 
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problems or research findings. There 
are formal classes in such areas as 
factor analysis, test theory, or the 
measurement of nonintellectual factors. 
Periodically, there are classes in 
computer programming. There are also 
opportunities of a more informal nature. 
For example, a scholar may wish to be- 
come better acquainted with the process 
of test development and so may elect to 
spend some time working with a team In 
the Test Development Division. Or he 
may be Interested In problems of scal- 
ing and equating tests and so may elect 
to spend a period of time in the Test 
Program Research and Statistics Divi- 
sion* Whatever the research question 
he nay raise, there is a specialist on 
the ETS staff to vho^ it may be referred. 

The potential leader in the field of 
educational research needs skill in pre- 
paring research proposals which will 
arouse appropriate Interest and attract 
financial support, if he la to carry 
out research of high quality. As one 
aspect of the supplementary program, 
each participant will prepare a formal 
proposal for a research study which he 
expects to carry out on returning to his 
regular position. 



APPLICATIONS 

To the U.S. Office of Education 



Educational Testing Service is one 
of the institutions eligible to receive 
funds under the Educational Research 
Training Program of the Uulted States 
Office of Education and la therefore an 
institution which may be named on appli- 
cations for one of the National Postdoc- 
toral Fellowships which will be awarded 
each fiscal year. 

Applications for participation in the 
DSOE program during any fiscal year be- 



ginning July 1 should be filed by 
December 1 of the preceding year. 
Requests for application blanks and 
for additional information should 
be addressed tot 

Research Training Branch 
Bureau of Research 
U.S. Office of Education 
Washington, D. C. 20202 



To Educational Teatlna Service 

While BTS can provide no funds 
directly to scholars, candidates with 
financial aupport from sourcea other 
than USOE (e.g. , private funds 
foundation granta, etc.) may sake di- 
rect application to BTS for partici- 
pation in the prograa. Letters of 
application should include a summary 
of acadeaic background and work expe- 
rience, the area in research which is 
of eapecial interest to the applicant, 
and the length of tlae he would like 
to spend at Educational Testing Service. 

Applications for participation in 
the prograa during any fiscal year be- 
ginning July 1 ohould reach ETS by 
March 30. Applications or requests for 
additional information should be 
addressed toi 

Director 

Postdoctoral Prograa in 
Educational Research 

Developmental Research 
Division 

Educational Testing Service 

Princeton, Mew Jersey 08540 



EDUCATIONAL TESTING SERVICE 

Educational Testing Service is a non- 
profit organisation that conducts test- 
ing programs, publishes tests, provides 
evsluation, advisory, and instructional 
services, and engages in research. It 
has as its primary goal the discovery 
and development of hiaan talent through 
the effective use of teats and measure- 
ment techniques. 



* 
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Please complete this application and send to: 

Director, Postdoctoral Fellowship 
Program in Educational Research 

EDUCATIONAL TESTING SERVICE 
Princeton, New Jersey 

Date 



Miss 
Mrs. 
Name: Mr. 



Address 



Date of Birth 



Name of Nearest Relative 



Address of Nearest Relative 



Undergraduate Work : 
College Attended = 
Major Field: 



Date of Graduation: 



Tel. No. 



American Citizen? 



Relationship 



Minor Field: 



Degree Received: 



Qraduate Work : 
Institution^ 
Field: 



Approximate Dates^ 
Thesis Sjponsor: 
Thesis Title: 



Degree Received: 



Institution 

Field: 



Approximate Dates :_ 



Dissertation Sponsor^ 
Dissertation Title: 



Degree Received t_ 



Academic Honors, special awards, and offices: 
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List publications or special activities related to educational or social 
science research* 



Work Experience* 





t 
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Oive a resume of a project in which you have participated which is pertinent 
to your application for the Postdoctoral Fellowship in Educational Research: 



Describe briefly one or two studies which you would like to do: 



O . 
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Have you taken any of the Educational Testing Service tests, and if so when? 



College Entrance Examination Board 

Qraduate Record Examinations 

National Teacher Examinations 

Others* Name of test 



Month, Year 
Month, Year 
Month, Year 
Month, Year 



Names and addresses of people who are familiar with your training and your worki 



If your credentials are available from a Placement Office, please name the of fleet 



Signature 

O 



I 



!' poor ordinal copy -best CERTIFICATION FOR POSTDOCTORAL FELLOWSHIPS 
| AVAILABLE AT TIME FILMED . IN EDUCATIONAL research ; 

f 



POOR ORIGINAL COPY- BEST 

AV /- - — .. 



In order to provide ETS and the U. S. Government with information necessary- to 
determine the stipend for the postdoctoral fellowships in educational research 
for the fiscal year 1966-67* the following information must be certified by 
the home institution of each fellow: 

I* The annual salary for the year 196^-66 and whether the salary is stated 
on a calendar year or academic year basis. 



I 2. The annual salary to which the fellow, would be entitled for the year 

: 1966-67 were he to remain at the home institution instead of accepting 

1 the postdoctoral fellowship. This salary should be quoted oh the same 

I basis as the salary for the 196^-66 year*and. should be consistent with 

general institutional policy on salaries, that is, it should not con- 
i stitute a special increase in anticipation of the fellowship. 



3, The remuneration which the fellow will receive from the home institution 
while occupying the fellowship. This would include any sabbatical pay, 
retirement, insurance, and the like. 



U • Certification that the fellow has been granted a leave of absence from 
the home institution and is eligible to return to the institution at the 
expiration of the fellowship. 



* 



o 
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1 . 



has been employed by 



(name of institution) 



and 



(name of fellow) 

between July 1, 1965 and June 30, 1966 at an annual salary of 

i 

that the salary covers (a) the academic year or (b) the calendar year 

# 

2. The corresponding salary for the year 1966-67 would be $ ___ if the 

• * * 

individual were to remain at the institution rather than to accept the fellowship • 

3. -During the period from 1966 to 1967 the individual 



will receive no remuneration, either real or in kind, from 



other than 



(the institution) 



(specify each type of remuneration and appropriate money value thereof 
for the time period) ! : 



. lit • ___ has been granted a leave of absence from 

(name of fellow) “ 

1966 through 1967. 



1 certify that tho above information is true and correct to the best of ay 



knowledge and belief. 


• 


kame of Officer 

* 

■* « « f 1 


kame of institution 


Signature 


bate 



, certify that I am the 



of 



who signed this certificate 
of said institution; 



** - - 

the institution named herein; that . 

On behalf of the institution, was then 
and that said certificate was duly signed for and in behalf of said institution by 
authority of its governing body. 

• ■ (SSAf.) 



«- 



P&OR ORiGJNAl' COPY • 8Pcr 



Signature 



O 

ERIC 



/ 



